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Abstract 


This paper explores the development and impact of 
new visually coupled system (VCS) equipment designed to 
SUppOrl engineering and human factors research in the 
military aircraft cockpll environment. VCS represents an 
advanced man-machine inberface (MMI), whose supertority 
over the conventional cockplt MMI has not been 
established In a conclusive and rigorous fashion. What has 
been missing Is a “systems* approach to technology 
advancement that is comprehensive enough to produce 
conclusive results concerning the operational viability af 
the VCS concept and werlfy any risk factors, which might be 
Involved with {ts general use in the cockpit. The overall 
System concep and Lhe design of one important subsystem, 
a new militarized version of the magnetic helmet mounted 
sight. are discussed In dctall. Significant emphasis is given 
to Ulustrating bow particular design features Im the 
hardware Improve overall system performance and support 
research activities, 


Introduction 


The last six years of advanced military equipment 
development activity, and particularly the last four, have 
been marked by a@ renewed Interest In the application ot 
visually coupled system (VCS) technology to the military 
aircraft cockpit, Moat since the early to mid 19705 has the 
activity level been so intense for militarized versions of 
this technology. Much of the renewed developmental 
activity has, dghily, concentrated upon the helmet mounted 
display portion of the VCS. This fact is demonstrated by new 
helmet mounted displays (MMDs) from such manuwlacturers as 
Hughes Aircraft, Kalser Electronics, GEC, and Noneywell. 
and Dod activites Whe the Anny LM Melicopter Program, the 
Air Force F-16 Night Attack Program, and the joint Mavy-Alr 
Force INMGNTS Program. The emphasis on HMD design 
(particularly its size and welght) is because it has been a 
major perornance-limiting factor to the widespread safe use 
of the technology in ejection seat aircraft. Mowever, the 
successful integratlon af VCS technology Into the cockpit 
Includes the salutlon to a number of wilization and 
Peformance problems thal cross the boundaries of many 
technical disciplines. A few of these are: 


1) Providing further insight inte and perhaps some 
solutions to. the more Important remaining HMD human 
factors problems, Among them are the establishment of 
appropriate Instantaneous flelds-ofview (POVs) for specific 
categories of missions or vehicle types (which are 
defensible with statistically meaningful quantitative data, 
eye accommodation as lt relates to viewing collimated sce- 
through displays, and binocular rlvalry issues (elther 
between eyes or bebween the display and amblent Imagery. 


2) Froviding @ display with a visual Interface 
supporting sensorgeneraled and compuler-jenerabed 
information that reduces operator workload and 
demonstrates quantifiable improvements in operator 
performance, 


3) Solving the blodynamie Interference suppression 
problem for the helmet display, 


4) Providing complete day-night operablilty with ane 
HMB system, 


3) Froviding a VCS with the necessary spatial and 
temporal bandwidth while malntaining modest head-bome 
welght and an equipment configuration that ls compatible 
with current alrcraft ejection scats and safe for rapid 
ground-egress in explosive vapor environments, 


6) Providing a heimet display, image source, and image 
source electronics combination that optimizes thelr own 
Interface, can be easily adjusted for variations In human ancl 
hardware, parameters, and supports the display of computer- 
based and sensorbased Infornation., such that the entire 
sensordisplay subsystem is not display limited. anc 


7) Evolving a helmet mounted position and orientation 
tracking system that fully supports is own Cockpil 
Integration. [ts Integration with other subsystems 
comprising the entire VCS, and provides a usable and 
reliable man-machine interlace (MMI). 


The above st, which shoukd not be construed a5 
exhaustive, represents oo general first level list of 
Interdiselpiinary issues that, In the authors experience, 
have been observed toa be Important and need further 
Investigation before one can feel reasonably secure about 
the general adoption of VCS technology for milltary alreraft. 
tems In one, two, and three represent the blophysical, 
engonomic, and ‘system’ human. factors issues for which 
appropriate Instrumentation and testing Is needed for 
clearer resolution of thelr significance, lems four and five 
relate to developmental Issues for which addtional ime and 
dollars will be needed to achleve adequate levels of 
performance, and to which development efforts. such as the 
one described In this paper, can make @ serious 
contributlon. (bem six and seven directly address VCS 
functional and performance related issues that support state- 
ofthe-art (SOA) advancements in both research<directed and 
productlon-directed systems development. Many system 
develapment issues have both @ ‘developers’ and “users* 
sense to them, and both require relatively ecjual time and 
resource commiiment, Before valld technical positions can 
be legitimized. or the solution to parts or all of some of the 
above issues can be found ofr developed, [t will be 
necessary to require partial or complete WCS testing in 
operational environments with harniware that embodies SOA 
capablilty, it can be argued that, In many Instances, a ‘best* 
approach to a "best" solution is to have at hand SOA 
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hartware that has the required ‘programmablulty* to support 
engineering and human factors research and alsa the 
Fuggedness to be operated In the Mnal Intended 
environment. in this case the military alreralt cockpit. 
References [02,05] have already described most of the 
requirements and system Inteqration issucs surrounding the 
head-mounted display and Its Immediate supporting 
hardware, This paper investigates some recent research and 
development activities al AAMBL Invealving the VCS 
electronics that directly support the helmet mounted 
components, The discussion covers the ratlonale 
SUTGUndINg thelr primary operational characteristics. their 
Impact on the current state of VCS lechnology, and tries to 
demonstrate how some of the lssucs enumerated in one 
through seven above are being resolved. 


A “Research-Orlented" Visually Coupled System 


Figure | depicts one varlation of a VCS system, the 
Virtual Panoramic Display (VPD). This system [s designed to 
Support all types of helmet-mounted displays (HMDS) using 
miniature cathode-raytube (CRT) image sources, Including 
Partlally overlapped binocular displays. It provides the 
basic helmet tracking and display presentation capabilities, 
However, If alsa supplies the configuration 
programmability, Interface flexibility, and self-contalned 
data collection meeded tO support advanced research 
activities addressing the above mentioned 
utilization/perlormance issucs. Beginning with the head- 
mounted components, the visual subsysiem (AMD) may 
Include ether one CRT image source and one or two optical 
channels, providing @ monocular/biocular display 


presentation, or 2 CHTs with dual independent optical 
channels making possible a true binocular tation. The 
visual flelis may be elther fully or partially overlapped and 
may be allgmed, using programmable electronics, 
penmlititg, Wf desired, the presentation of trove stereoscopic 
images. The CRTs, employing. in most cases, nanrow-band 
emission phosphors, may be any of line standard bipotential 
lens designs commonly avallable, or be of an advanced 
design Including additional grid control elements, The CRTs 
ane interfaced to specially-c analog helmet-mounted 
display ¢lectronics (ANHIDE) which ‘tallor the displayed 
Informatbon to the requirements of both the MMD optics and 
CAT design. A major tnrust of current visual display research 
for the military cockpit assumes that mission equipment 
package (MEF) data and sensorgenerated information must 
be “fused", in part visually, in some oplimal manner on the 
HMO to help improve the pilot's moment-to-moment 
situation awareness. Thus, the VPD AHMDE has been 
designed to support a range of anticipated video Input 
combinations for sensorgeneraled and computer<enerated 
visual Information that can be displayed simultaneously on 
the CRT. Much of the displayed information must be 
changed and/or updated. based upon the pilot's 
instantaneous line-oFsight (LOS) and helmet posiifon within 
the cockplt, Ta provide this function, a magnetic helmet 
mounted sight (MHMS) Is Included that provides both 
helmet attitude and positon vectors. The newer version of 
the MHMS used for this VCS configuration can be 
Projrammed to compensate for certain environmental 
disturbances to which lt ls susceptible. To promote ease of 
Programming and transition to-and from qround-baged grec 
alrbome research environments, a combination of Digital 


| 
; 


Generic VCS System Nardware Block Dlagram 


Equipment Corparation Q-Bus and UNIBUS processom and 
Motorola 68000 familly VME processors have been employed 
a5 both imbedded and stand-alone processors. To facilitate 
data transfer beyond the ilmitations of the milltary 154535 
data bus. a variety of high speed Interfaces Including a 
Mulli-port shared memory (MPSM), which exists in both 
laboratory and militarized form, were developed. The MPSM 
aliows up to ten BEC or VME-based processors to 
simultaneously pedo parallel read and write operations 
between each other. To facilitate non-volaiile memory 
storage, militanlzed hard disks are avaliable for the DEC- 
based processors and EEPROM for the VME-based 
processors, This architecture fosters ease of expansion 
when additional processing power & needed. and permits 
additional enhancements, such as auditory localization and 
Physiological best Bathery monitoring. bo be added to the 
basic VCS, a5 needed and available. The shaded area of 
Figure 1 represents the core components of the VCS 
electronics subsystem for most near-term VCS 
configurations. Due to length considerations, this paper will 
focus the remainder of the discussion on just the portion of 
the shaded region that Includes the MHM5, emphasizing 
advancements that facilitate not only hardware peronnance, 
but also improve or faciiltate the VCS Interface and 
research activities, Some discussion in a similar vein 
relating to the helmet mounted display electronics can be 
four in (62). 


The Helmet Mounted Sight ‘Providing a More Complete 
System Concept" 


Many critical plot activities Involve, to some degree, 
the rapid acquisition of information, the accurate and fast 
positioning of display symbology depicting system state, 
and, after sultable cognition time on the pilots part. the 
execution of one or more alrcralt system state changes. If 
the man-machine Interface (MMI) through which this 
interaction is belng effected is a VCS, then the spatial 
relationships and positional accuracies of information 


portrayed on the HMD, as determined by the HMMS position 
and orientation (F&O) tracking data, are very important. Mot 
only must the quality of NMS attitude and position 
Information be guaranteed lo some known and repeatable 
baseline level of accuracy, but lt is also desirable bo be 
able ta enhance the VCS's immunity to environmental 
disturbances to which the HMNS or human operator are 
susceptible (at least In a ‘signal-to-nolse-sense" to @ 
threshold near or slightly beyond the limits of systern-alded 
human perception). The MHMS, despite the complexities of 
correcting for electromagnetic scattering, is still regarded 
as the NMS system of choice because of Its megged small 
transducers. immunity to other types of environmental 
problems associated with military vehicles, and the speed 
and accuracy of the six-degree-ol-freedom (6DOFr) 
oflentation and position data that the MHMS can provide, 
Figures 2 and 3 depict the pomary system clements and 
their Interfaces for the new VFD MMMS and its functional 
organization, 


The core of the improved MHMS gysbem is ls new PaO 
algorithms developed for AAMBL by Green Mountain Radio 
Research Company (OMRR). and the hardware parailel- 
processor architecture developed by the Kalser Electronics 
subsidiary, Polhemus, Inc (Fl), The new algorithms both 
Improve system tracking accuracy and penmit the effect of 
many environmental disturbances to be substantially 
redweed, The primary P&O tracking algorithm is a minimum 
variance linear estimator (MVLE}. The MVLE makes direct 
use of the magnetic-fleld characteristics and satisfies three 
objectives: (1) obtaining a least-squares best fit to the 
measured magnetic elds, (2) providing minimum expected 
Measquare emor in PRO, and (3) providing maximum 
likelhood F&O estimates. Under conditions of wery rapid 
and continuous head movements, the MVLE algorithm cannot 
pave ConvEnence to an accurate PaO solution, As shown 
In Figure 2, ‘supervisory’ software checks for such 
conditions. and, when detected, switthes the P&O solution 
Pprecess to a nominear estimator (MLE) algorithm, The MLE 
makes direct, moniteralive estimates of PAO, and, while lbs 
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Becuricy is nol as great as the MVLE, its stability is 
absolute. Thus the MVLE and ALE are complementary. Under 
normal operating conditions, the MVLE provides the most 
aecurale PaO estimates, while the ALE ensures correct 
initislization and recovery from very large and continuous 
step inputs and power disruptions. Signal oversampling and 
a ‘matched filter are used on the front end to obtain the 
needed signal-to-noise ratia (SNR) and minimize head- 
mounted CRT interference. The hardware provides the 
Necessary computational power and system upgrade 
flexibility, Including optional accelerometer inputs, Tiks 
flexibility permits adding tracking filter implementations 
to Ehe HHMS outputs, whose programmed characteristics 
Allow selective modification of its oulpuls, based upon the 
operators tracking Inputs and environmental disturbances, 
The primary purpose of the filtering is to improve operator 
LOS placement accuracy and to improve information 
extraction from the HME. 


The primary update rate for F&O tracking of a single 
helmet is an impressive 240 updates per second (UPS). 
Figure 3 indicates that as many as 2 heads and 4 hands can 
be Independently tracked using separate P&O sensors. 
However, Chis maxinvurn configuration reduces the update 
Tate to 60 and 30 UPS for the heads and hands, respec 
Separnie update cycles are needed to first sample and fliter 
the raw fleld data, and then determine true P&O estimates, 
This reduces the data throughput rate to at least 1/2 of the 
Miki updabe rate, AS Shown in Figure 3. the MHMS Gan 
be ‘synched’ to an external source or clock, This feature 
tan be Important for applications Involving compuber- 
generated Imagery where obtaining equal updates of head 
PAO ff desirable for the display of moving objects on the 
HMD. A setup control panel (SCP) can also be interfaced 
directly to the cockpit side of the cockplt control panel 
(CCP). The SCP allows bullt-in test functions to be accessed 
and system parameters modifled without removing the 
system from Live alrcralt. 


The MHMS system is complemented by a 
programmable, semi-automated mapping fixture which, 
during the cockpit mapping and compensation is. 
connected to the actual HAMS system that will be installed 


In the cockplt. The mappers computer shares data with the 
MHMS processor hardware. Using a desired system error 
budget, the mapper system gathers preliminary raw magnetic 
field data based upon a completely quantitative process for 
Allocation of the field mapping data points. Thus, the 
denuiy of the sampled cockpit feild data ls controlled by 
Solutions delved directly from computations Involving the 
actual MMHMS hardware and MVLE/MLE algorithms. A similar 
approach bs weed for mapping the magnetic fleld conditions 
induced by helmel-mounted scatherers, with mespect to thelr 
fixed relationship to the helmel-mounted sensor. anc. then, 
campullng the needed Meld compensation coefficients. 
Taken together, this new ‘systems’ approach to the MHMS 
will provide superior tracking accuracy and complement the 
overall quailty of the VCS MMI, 


MHMS Perlormance: “Technology and Research-Based 
Requirements” 


At the beginning of the VFO MHMS program, @ set of 
performance goals was formulated based upon a 
Programmatic mequinement to demonstrate weful technology 
advancement and, also, the need to support research In 
operational alrcraft environments. The most Important of 
these Were: 


1, Enlarge motion box performance to provide reliable 
coverage of head and hand position and orlentation 
throughout the cockpit volume, 


2. Improve static accunscy to levels approaching the NUD (1 
- 3 milliradians) to support most weapon system Interface 
uncHons, 


3. Improve update rate and throughput rate bo support 
auditary localization. as well as. visual subsystem data 


requirements, 


4. Provide a system capable of investigating techniques and 
equipment that enhances system and human operator 
immunity to external disturbances, thus, allowing the 
Improvement or modification of system signal processing 
functions, and 


3. Implement @ system supporting research oriented 
activities that could be used In both ground-based and 
airbhome environments. 


System Concept Basis: “Establishing System Error 
Criterla™ 


Once system requirements were set down, it quickly 
betaine apparent that a new approach to the MNMS software 
and hardware waa required, Por the hardware, developing an 
affardable militarized architecture that was flexible ane 
offered the highest computational mtes was evolved, for 
the algorithms. whose characteristltas would largely 
determine overall performance. a joint program with OMAK 
was Initiated to dently how the data in the MHMS flelds 
could be used bo compute PaO with minimum enor and 
identify factors that limited the computational process. For 
the MHMS system, allocation of a total system error budget 
Was made @arly and a concerted effort has been made to 
meet it particularly because of the parallel development 
process weed In the program, 


The system emor budget and design equations are 
based upon two bade concepts: (1) expected mean-square 
measurement error (EMSME) is convertible into an expected 
mean-square estimation error (EMSEE) through a scale factor 
and (2) EMSME Is expressible as the root mean square (RMS) 
of the various error sources, Equations | through 7 
illustrate, in less than rigorous fashion, the basis for the 
error budgel allocation. For convenience, the development 
is shown for LOS only, though similar processes were used 
for total orientation and position error. Equation 1, 
species major sources of RMS estimathon error for LOS, 
where the expected AMS error is the square root of (1). 


Oo =a + oy (1) 


where: yearimuth, 0 = elevation 


Olven prior Knowledge of the MHMS feld 
characteristics and the absence of a detailed model for tts 
measurement it ls reasonable to assume that the errors in 
all measurements ane Independent (untomelated) and have 
equal variances which lead to the relationships in equations 
2 and 3, relating estimation enor to measurement enor. 


2 2 
oT EMy-y) (2) 
arid 
0,7 = (8, Fa? (3) 
wihtere: El(t-%, 7) = variance of measurement 
error 


Sp = sensitivity factor dependent upon 


magnetic field characteristics and 
units of measurement 


Analysis performed with both OMER and Pl determined 
three principal independent, uncorrelated sources of 
Measurement emor. The varlance of these measurement 
enor can be expressed by equation 4. 


O = Oy + Oy + OR (4) 


where: om = mapping fixture emror 
oy = measurement woke 
of = fled prediction enor 


The mtasurement of varlance caused by noise and 
fleld measurement errors. which are essentially random and 
readily specified in berms of @ measurement. are multiplied 
by an appropriate sensltivity factor (S'). describing 
magnetic fleld characteristics for free-space and flxed 
sCalterers. a4 shown in equation 3. The accuracy of the 
mapping fixture is more conveniently specified in terms of 
position and orientation error or variances as denoted by 
TUM in equation 3. Equation 3 can be used directly to 


Predict RMS estimation enor from the magnetic Meld 
sensitivity factors and varlances of the three measurement 
Errors. 


OL = yyy) + (SY (oy + op) 5) 


Table 1 depicts the static accuracy requirements In 
tenms of circular enor probable (CEP) originally specifed 
for the MHS. If the assumption is macte that the estimation 
ermor are Qausslan and uncorrelated, then the relationship 
In equation 6 can be wed to calculate the AMS emor. Using 
(6). Rand ¢ can be computed by equating (6) to the desired 
Static @ocuracy. 


Tabic I 
Relationship of CEF and AMS Errors 


STATIC 
ACCURACY O(AMS) Ov(AMS) 
CEP AEQUIREMENT AIFROM(6)) DEGREES RADIANS 


oso az 1180-02"  o7169* ono295 
o99 oa" ano-048  o132° 000230 
RK? = -207 In[ 1-P(r<R) } (6) 


Where: Pir sR) = l-exp(-R/ 207 } isthe 
probability of a radial error not exceeding 
a radius of A. 


To arrive at a final estimate for the distribution of 
SyYStEM @rror, One Must return to equation five and use some 
trial estimates. To determine SNR requirements, it is more 
convenient to we a normalized relathonshlp, mither than one 
dependent on system unlts. Therefore, a normalized 
sensitivity function a, Ia substituted for S') in (5). Fis 
inttial estimate for mapper error was -0.0009 radians while 
OMBR'S research into field measurement sensitivity 


produced values for G that varied from about 1.63 for free 
space conditions to 4.42 for conditions Involving two flxed 
scattering planes, Using a worst case estimate from Table 1, 
and substituting Into (3) produces equation 7. Finally, 


assuming equal RMS errors for noise and fleld prediction 
leg. a," = o,"), and a worst case G, of 4.42, the normalized 


system SMR can be determined in a few simple algebraic 
steps. as shown below, 


0, "= (0.00230)"= (0.0009)"+ (G, )"(oy +0, ) (7) 


. 2 ‘- Z Fi 
(0.5)(0.00212) =(G,}(ay)” => oy = (0.00212/G, ) 


= Gy = 6.000355 


The results show for worst case conditions that a SNA 
of greater than 69.4 di is needed to meet MMS error 
requirements, These results helped focused continuous 
attention throughout the MHMS development on the 
procedure used to transmit and process the received 
tlectromagnetic signals. the mapping fixture design and 
concept for tts ulllization, and a number of refinements In 
the design of the P&O tracking algorithms that intludes 
Calculation In a fioating potnt format. 


Improving MHMS System Accuracy: “Static* and 
*‘Dynamic* 


The desired error performance [6 demanding and 
execeds the performance of the standard 12-bit MMS 
systems now available, The key factors helping the new 
aystem to meet this amblilous goal are: 


1, Improved MNMS algorithms that embody associated 
analysis explicitly defining and characterizing system enor 
SOUT 


2. An integrated and automated mapping fixture. and 


3. MMMS hardware that includes special front-end digital 
signal processing hardware, improved update rate and 
resolution, and a slightly larger source [radlater or 
tranamitter) size. 


An adequate system soluiion has iired a more 
‘technically-complete’ approach to the MANNS development, 
AS a result of the early and In-depth application of applied 
mathematics, the MVLE algorithm was evolved and has 
become a key element for improved MNMS performance, 
The MVLE has two especially desirable propertles when 
used with a magnetic P&O tracking system [3): (1) It 
provides the most accurate estimates fram noisy 
Measurements and (2) rather than assume a free space 
condition that must be comected, as other MHMS algorithms 
have done, lt makes direct use of the magnetic-Netd 
characteristics. It ls the second property of producing a 
comect estimate directly from the magnetic-feld conditions 
that allows the MHMS sensor to be tracked more accurately, 
even down to conducting metal surfaces, The algarithen 
design also enhances the incorporatian of moveable 
scatterer compensation (forthe head mounbed CATS) Imbo the 
primary PeO algorithm, Oversampling of the MAMAS signals 

find @ matched-filter opiimize reception of the separate and 
simultaneous three-axis winding signal excitation 
frequencies, The matched-flter Gan alsa provide attenuation 
of the radiated CRT deflection nolse al the line rate 
frequency for the MMD raster imagery, The matched-fiter 
implementation is essential to ensuring the -70 dp 
signal/noise ratio (SHRI for worst case conditions is met. 
The SMR Ls also improved by a slightly lamer source, true 
14-bit resolution of the magnethc Meds, and distance- 
related galn changes In the radiated B-fleld strength, A 
whole hast of signal processing refinements, beyond the 
scope of this paper. are used to improve P&O tracking 


periormance, Including compensation for finite transducer 
slze¢ effects, écab-moverent compensation. and reduction in 
the bulldup of computational errors. Because the M¥LE 
tracks incremental changes in the magnetic ficids, a higher 
update rate improves its stabliity. The operation of the 
MVLE Is signal-dependent. It can remain stable for large 
step inputs of several hundred.d ecorned, Wf follawisd 
by relatively stathc fleld changes or (f fed continuous 
Incremental inpuls per update cycle that change by no more 
than about one to two degrees. Olven the new MHAMS's 
Update mate (up to 240 updates/second), the MVLE can 
remain stable for head movement rates of hundreds of 
degrees per secomd. However, the peonnance boundary is 
matte fuzzy because of tts dependence on changes between 
incremental updates that are debermined by head movement 
and system confiquraliontlependent update rates. Therefore, 
as Pigure 2 shows. ihe software Includes a supervisory 
process which switches the MHMS PaO solution_to a MLE 
whenever stable solution criteria are not met, A sample of 
simulated MVLE tracking performance is shown In Figures 
4a and 46, The figures clearly show that the presence of 
fixed scatterers affects the minimum error that can be 
obtalned, But the error foar (0.0001 radians or 0.34 arc 
minutes) meets system enor requirements. 
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Figure 4 
Representative MVLE Orientatlon Tracking Performance 
for Free-Space and Fixed Scattering Environments 
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The implications of the new MNMS performance for 
the VCS are Important for both operational and test 
applications. The new system algorithms and hartware 
improve sialic atturacy to an estimated | or 2 milliradians 
within the “MUD Box" (+30° in azimuth and elevation), and 
to about 4-6 mililradians -throwghout the entire mothon box. 
Accuracy is also quantified better by the Interactive 
Mapping fixture design, whith bs an important improvement 
for research oriented activithes. Resolution has also been 
improved to better than 0.4 mililradians. Resolution can be 
a significant parameter for head-driven display 
presentations where small head movements can be debected 
on the HMO presentation under conditions of high apparcnt 
magnification. 12-bit PaO tracking systems have been 
observed to Cause undesirable and detectable discrete 
jumps in the bocation of the display imagery on the NMD 
during small head movements. 14-blt systems seem to 
provide enough additional resolution to make this artifact 
virtually undetectable. There are tradecofis associated with 
the Improved ; petormance. Achieving the added SMA 
needed to attain an honest |4-bit system requires a larger 
source. The lamer sources measure 1.25 inches to 1.5 
inches square and weigh between 7.5 and § ounces, The 
ideal mounting location In fighter aircraft is on the cockpit 
canopy behind the pilot. The larger and heavier MHMS 
source may be too heavy for mounting In same cockpit 
canopies jé.g. the P-16) because birdstrike Induced canopy 
WEVES are more prone bo cause canopy failure with the 
heavier MNMS source mounted in them. 


Most MHMS system Paso algorithms require at least 
two Uplate cycles to Gbtaln pede convergence bo accurate 
measured dynamic head location outputs. The new MAMS bs 
ne exception, as Mgure 4 Indicates. The higher update rate 
reduces the convergence latency problem down bo 
manageable levels. It also alds the throughput delay 
problems for computergenerated imagery systems which 
must place thelr imagery on the HMO accearding to the 
MHMS PO updates. Por applications, such a5 auditory 
localization. even higher update rates may be desired, 
because the car can follow position update latencies in 


sound fleld vectors below one millisecond, A higher update 
Tate also alds one area of MHMS performance that is 

Wlarly hard to quantify: system dynamic accuracy. The 
problem with this requirement 6 lis measurement. Past. 
development efforts that have investigated this problem 
have resulted In budgetary estimates of 3 to 4 hundred 
thousand dollars to produce an adequate test fixture. This & 
an amount that meager development budgets have not been 
able to handle with competing commitments of greater 
overall Import. Perhaps a good alternative for the MMS is the 
achlevement of higher update rates which reduce the 
latency bebween the measured and real head position and 
orientation and, thus, inherently improve system dynamic 
ACCUMACY. 


System Desiqn and the Operating Environment: 
Inproving Pilot Confidence in VCS 


For most VCS applications. it is desimble to have the 
entire head movement mange uncer which functional display 
presentations are to be maintained. covered by normal 
MHMS operation. This viewpoint Is often confirmed by 
expertence with test pilots and the feedback thal they 
provide conceming thelr experiences with VCS. This 
clreumstance can oocur in many present MAMS systems 
when radiatorsensor range if exceeded or unusual pilot 
head atthhuecdes occur during mission performance which 
Place the helmet mounted sensor near electrically 
conductive surfaces. Such artifacts are deemed to be 
unAccepable by most operational personnel with extensive 
VCS experience. As mentioned, the cockpit mapping and 
system compensation approach employs an automated 
mapping flature, The computerized control interface 
between che mapper and MHMS system and iis algorithms 
Permits precise sampling of the cockpit electromagnetic 
fleld environment to ascertain that the desired error 
peronnance, cockplt environment, the system soltware. and 
operational helmet configuration are adequate. Until the 
development of the new MMMS, movement of the helmet 
Sensor very near to conducting Surfaces could Produce 
wildly jumping display imagery. An undesirable solution to 
such problems has been to freeze LOS signals at thelr last 
known ‘good field’ condition. but the HMD Imagery as 


positioned by the HMS will not reflect true P&O. The new 
MMS algorithms now permit the sensor PaO to be tracked 
down to conducting metal surfaces and permit the graceful 
degradation of system accurcy and resolution to 13-biis, 
12-bits, etc. for conditions where the maximum full 
Tesnlulian source-sensor minge is exceeded. Therefore, a 
more siringenl sensor tracking requirement that favors 
reliability of Ihe MHNMS-controlled placement of the HMD 
scene contents does not now Imply a new, high risk 
development effort. It dots Imply. however, a greater 
allocation of computational power to the MHMS function 
than is offered by other available variations of the MMMS5. 
millarized or Commercial, 


Another aspect of the MAMS signal quality problem 
Invealves the effects of head-mounted dynamic scatterers. 
Lising @ helmet orfentation and position tracking system to 
direct weapons and place/siabilize imagery on the HMD, 
makes consistent system PRO outputs a necessity 
Obtaining F&O tracking consistency for the MHMS Involves 
two major system Integration issues. The first Is where the 
pliot must or might place his helmet during any mission 
eventuality, The second is the spatial relationshlps of both 
the other helmet components (especially thase that can 
distort or attenuate the MHMS3 magnetic Meld) and the 
MHMS source. (transmitter) with respect to the helmet 
sensor location. The major, but not the only, shgnifcart 
helmetmounted scatberer & the CAT. Figure 3 Ulustrates 
the nominal tocation volumes of the helmet mounted CRTs 
for the usual Binocular and monocular/blocular HMB 
configurations with respect to the MHMS sensor. The Icical 
mounting location for the MHMS is on the crown of the 
helmet. in part. because this location is distanced from 
many sources of interference, and because the Ideal 
location for ihe MNMS source is to the rear of the pilots 
head in the helmet canopy or above the seat back. CRT 
locations | ‘and 2, shown In Pigure 3, can be particularly 
bothersome to reliable MMMS operation for head attitudes 
that Include a directed LOS toward the side or rear of the 
Bircraft with positive clevation angles. VCS Integration 
planning should give consideration to such relationships 
and the tradeails they imply. In $0 doing. an allempl should 
be made to place the sensor on the helmet and the 
bransmitber in the cockpit at positions whene obscuration af 
the transmitters signal (by a helmet CRT, etc.) due lo head 
movement Is unlikely or impossible. Dynamic compensation 
for the movement of the head mounted CRT(s) may be 
crithcal to overall system tracking performance, capecialily 
if two CRTs are used or the mounting geometries of the 
CAT(s) and sensor cannot have opllimum locations, A lope 
mounted CAT centered on the crown of the fight helmet for 
biocular HMD designs often poses the most serious 
problem, 


One former approach to compensating for dynamile 
scatterers was to characterize the secondary field of the 
moveable scatterer and compensate for its effects using a 
dipole or muluiiipole model. This technique has not worked 
well, because the dipole locations are not really 
determined and thelr scattering parameters depend on the 
number of dipoles used (quickly raising computational 
overhead) and an accurate knowledge of the location of each 
dipole. Recent experience with an altemate approach [4] 
that characterizes the scattered field as a sum of the 
multipole flekis appears to have produced superior results 
in laboratory testing. Mowever, full operational best nesults 
will not be known for gore months after the publishing date 
of this paper. In this technique, the multipole moments are 
linearly related bo the primary magnetic feld and its 
gradients by a set of scattering coefficients that are readily 
determined from sets of scattered-fleld measurements by 
linearcoecMclent fitting techniques. 


The effect of fixed and dynamic scatterers on MHMS 
operation is important enough in the design and Integration 


of VES that a short discussion of basic considerations Is 
appropoate. An Initial assessment of the MHMS environment 
can be made to help reduce potential problema curing final 
aystem Integration by noting a few geametric relationships 
and the worst-case conditions for MHMS fleid distortion 
Cased by fized and helmet-mounted moveable scatherers. 
Figure 6 depicts the worsbtagse siluation for a fixed 
Scallerer in relation to the transmitter(source)- 
recelver(sensor) distance. This cocurs when the sensor Is 
directly below the source. Since amplitude for the MHHMS 
quaskstatic field is proportianal to the inverse cube of 
distance, the worst case distortion ratio (D) Is glven by 
equation (8) where ‘p* represents distance, Using (8) and a 
ratio of 5.5 for P5/?)- one computes @ distortion ratlo of 


ift11- 1 = 0.001 of 0.1 percent. A ratio of 2.62 would 
produce a distortion ratio of 1 percent, 


D= (p)92py-P,)9 = W(2pyp,- 1 (8) 
Where: P= 2P5-P) 
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Figure 6 
Fixed Scatterer Relationships 


Work performed during the development of the VPD 
MHMS at AAMEL and OMRR and documented In [4] helped 
to characterize the Meld distortion due to the presence af 
several types of simply-shaped dynamic scatterers, These 
Include spheres and prolate spheroids which resemble te 
shape of the normal cylindrical CRT. For the moveable 
scaltberer, the ratio between scatterertosensordistance (>) 
and scatterer size (if) becomes the dominant relationship for 
computing the distortion matio, nue the inverse cube 
relationship we now get D = ( fy p ee AS shown for the 
spherical scatterer in Figure 7. ae: distortan contours are 
simply spheres centered about the scattering sphere. for 
example, in Figure 7, a length of 4.64 f(where {= raclus of 
the scattering sphere) produces a distortion ratio of 1 
percent. As compared to a sphere with radius of §, a prolate 
apherold with semiasxis of f) =f and ® = & = 02 f 
representing about the eccentricity of the HMD CRT, 
produces maximum scattering no worse than about twice 
that of the sphere. The polnt of this discussion is thal the 
helmet syshem design greatly affects the method and 
complexity of the required dynamic compensation process 
in the MMS. If the HM design permits a lower mounting 
location for the CRTs as shown for location 3, in Figure 5, 
then the MHMS sensor may be placed at or near the top of 
the helmet. Located in this manner, the CRT scattereris) 
have a much reduced protwbility of blocking the MHMS5 
signal during head movement. The minimum scatterer/sensor 
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distance ratio will also be relatively large, A biecular 
design, as mentioned earlier, may. with most perferred 
sensor mounting locations, provide an increased 
opportunity for the scatberer bo block the source's signal to 
the sensor, Altemately, placing the MHMS sensor on top of 
the helmet near the CART scatterer to prevent signal 
blockage by the scatterer will signifleantly reduce (in a 
negative manner) the scatierer-to-sensor-distance bo 
scatterer size ratio, 


ik is also wise. and usually necessary, to Imbed some 
sor of capability into the MHMS to overcome situations 
where the HMD CRIS will completely block the signal ta 
the recelver untill an unobstructed line-olaight (LOS) can be 
Teestablished with the transmitter. The only good 
altemative is usually to hold the MMMS FAO output data at 
the last good field data polnt until radiated fleld conditions 
retum to atceptable levels, 


MHMS system signal properties are also influenced 
significantly by the material composition and structure of 
the overall VCS design, Of greatest concern are materials 
which, because of thelr physical properties. severely 
attenuate or distort the primary magnetic flelds, For 

le, conducting metal an the helmet, per se, does not 
siqnificantly degrade the uncompensated performance of 
the MHMMS, Rather large conducting surfaces, structures that 
allow current loops to form, and ferromagnet materlals ane 
the major contributers §o reduced perlornmance (i.e. greater 
System error). In particular, the VCS system integrator 
shOUId examine lis subcontractors production techniques 
to ensure that unexpected problem sources will nol be 
present. One significant problem involved aluminum 
shimiming rings for the NMD relay lens elements which were 
discovered to be causing stvene dynamic scattering of the 
MHAMS fields that was hard to compensate for satisfactory 
emor performance. The solution was to place a notch in each 
fing to prevent formation of current loops and secondary 
magnetic flelds. Thus, an improved system design. as 
represented by the VFO MMS and thoughtful Integration, 
tan complement ¢ach other to pres a more reliable plbot- 
centered or operstorcentered system, 


Optimizing Sight and Gisplay Utilization 


In this authors apinion, optimization is always a 
relative concept -— for one usually does the best that can be 
done at a given time with avallable resources. Among the 
VCS optimization Issues that have resisted a major 


improvement are the degradation of HMD performance 
Caused by alrcrall vibration transmitted to the head/nelmet, 
and the effects of system PHO delays or head movement 
artifacts on operator LOS tracking. LOS tracking can be 
further divided Into perhaps at least seven Categories or 
motes. which may have differing Implementations for 
optimal tracking fiber solutions. A possible set is: 


i) Pointing (at a statle target, 

2] Tracking (a distant moving bargetl. 

3) Close Tracking (target moving close to an observer) 
4) Handel? tof LOS from one observer to another for 
any made 1-3), 

5) Searching (for a new target, 

6) Transition (between one LOS and another), and 

7] Wandering ino specific LOS objective). 


Both alrcraft vibration and system Induced LOS transport 
delays for display symbology positioning can severely 
deqrade the operators ability bo exlract and/or use 
Infarmation presented on the MMD. As shown In Figure 2. 
the MHMS electronics unlit contains four Imbedded 
processor boards. One of these processor boards was 
intended for use in alding the investigation of the 
biodynamic interference suppression (vibration) and LOS 
tracking issues. Figure 3 depicts accelerometer inputs that 
can be used as an option for receiving direct inputs of head 
and aincraft vibration, The we of accelerometer inputs can 
provide improved stabilization of the NHMD image, and needs 
further Investiqalian, Often, however, systems utilizing 
accelerometer inpuls excluslvely perform poorly during 
large rotations of tne head, Stablilzation of the LOS signals, 
as derived from the MHMS PAO updates, using adaptive 
flitering. Is also possible. The effectiveness of such 
stabilization may be reduced, though, by the possible 
relatively large phase error thal can occur by attempling to 
stabilize over a Siz bandwidth wilh samples taken at #0 or 
60 Mz, The improved update rate of the VPD MHMS and the 
use of Kalman fiters or complementary filters (actually a 
form of Kalman (tering) that combine measurements of 
head PRO wilh accelerometer outpuls may overcome these 
difficulles. The VPD MANS provides not only the 
capablilty to run such algorithms, as they could be run in 
any computer simulation environment, bul also the 
Capability to test them in relation to operator performance 
in the actual alrbome environment. 


The programmable flexibility of the VFD MAMS also 
allows the beneflts of acvanced cuwelng modes to be 
Implemented ard studied. One example is coordinate 
Intersection cueing (CIC). In a Ch mode, physical cockpit 
switches, or switches lmaged onta a panel mounted display, 
are referenced to the MHMS source's coordinate system. 
Wiiiizing the 6OOF measurements of the MHMS, the location 
of these switthes is constantly recompubed by the MAMB, 
aibowing ‘no-hands-needed" LOS activation by the pilot with 
his MMNMS LOS reticle. Thls mode effectively duplicates a 
portion of the oculometer function without the need bo add 
this hardware to the helmet, 


Summary 


The VCS MMI represents a significant departure from 
the standard cockpit MMI in use today. The development 
approach for the major VPD systems comprising the VCS 
MMI should. if properly utilized, ald the transition to this 
athvainoed cockpit interface, For the MUMS, the closed-loop 
system implementation between the Installation and 
operational hardware should ald both the researcher and 
manufacturer, The benefits for research personnel should be 
extremely reliable data describing the accuracy of the VCS 
implementation and very flexible alrborne-quailfled test 
instrumentation, The result for a potential manufacturer 
should be better a prion Knowledge concerning Interface 
and production Issues, For example, a calibration process 


rellable and accurate enough to quarantee that the mapping 
process for one cockplt can apply in a labor savings manner 
to Uke configured cockpits, thus pennitting the mapping of 
one cockpit to suffice for an entire block of similar aircraft. 
Whether this system approach mects expectations remains 
for the delivery of the production systems In 1991 and out 
year testing and experience to confirm. 
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